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Abstract 

We consider optimization of nonlinear objective functions that balance d linear 
criteria over n-element independence systems presented by linear-optimization ora- 
cles. For d = 1, we have previously shown that an r-best approximate solution can 
be found in polynomial time. Here, using an extended Erdos-Ko-Rado theorem of 
Frankl, we show that for d — 2, finding a pn-best solution requires exponential time. 

1 Introduction 

Given system S C {0, 1}", integer d x n matrix W, and function / : Z d — > Z, consider 
the problem of minimizing the nonlinear composite function f(Wx) over S, that is, 

min{f(Wx) : x G S} . (1) 

This problem can be interpreted as multi-criteria optimization, where row Wj of W gives 
a linear function WiX representing the value of feasible point x G S under criterion i, 
and the objective value f(Wx) = f(W\x, . . . , W^x) is the balancing of these d criteria. 

Assume we can do linear optimization over S to begin with, namely S is presented 
by a linear- optimization oracle, which queried on w G Z n , solves max{u;x : x G S}. For 
restricted systems S, such as matroids and matroid intersections, or restricted functions 
/, such as concave functions, problem ([I]) can be solved in polynomial time [HE]- A 
comprehensive description of the state of the art on this area can be found in [5] . 

Here we continue our investigation from [1] of problem (pQ) where S is an arbitrary 
independence system, that is, S nonempty, and x < y G S with x G {0, l} n imply x G S. 

A feasible point x* G S is called an r-best solution of problem (pQ) provided there are 
at most r better objective function values attainable by other feasible points, that is, 

\{f{Wx) : f(Wx) < f{Wx*) , xG5}| < r. 

So it provides a suitable approximation to JT]). In particular, a 0-best solution is optimal. 

In [1], the case of d = 1 was considered, that is, the problem min{/(u;x) : x G <S} with 
it; G Z n . It was shown that for any fixed positive integers a%, . . . , a p there is a polynomial 
time algorithm that, given any w G {ai, . . . , a p } n , provides an r(a%, . . . , a p )-best solution 
to the problem, where r(ai, . . . , a p ) is a constant related to Frobenius numbers of some 
of the aj. In particular, for any p = 2 integers, r(a\, 02) = F(a) is the Frobenius number. 
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In this note we consider the problem in dimension d = 2. We restrict attention to 
2 x n matrices W which are {0, l}-valued. Then the image of S under W satisfies 

WS := {Wx : x G S} C {0, 1, . . . , n} 2 . (2) 

Therefore, the problem of computing the optimal objective function value of ([1]) is seem- 
ingly reducible to computing the image WS by checking if y G WS for each of the 
(n + l) 2 points y in the set on right-hand side of ([2]) and determining the minimum value 
of / over WS. Unfortunately, this so called fiber problem, of checking if y G WS, is 
computationally hard. In particular, already for S the set of (indicators of) matchings 
in a bipartite graph, over which linear optimization is easy, this problem includes as a 
special case the notorious exact matching problem whose complexity is long open [6]. 

Here we show that there is a universal positive constant p such that, already for d = 2, 
matrix W each column of which is one of the two unit vectors in Z 2 , and very simple 
explicit function / supported on {0, 1, . . . , n} 2 , there is no polynomial time algorithm 
that can produce even a pn-best solution of problem ([TJ for every independence system 
S Q {0, 1}™, let alone find a constant r-best or optimal solution. Our construction makes 
use of a beautiful extension of the classical Erdos-Ko-Rado theorem due to Frankl [3]. 

It is interesting whether our construction could be refined to shed some light on the 
exact matching and related open problems of [6], and whether other natural oracles for 
S could lead to polynomial time solution of problem ([1]) in dimensions d = 2 and higher. 

2 A pn-best solution cannot be found in polynomial time 

Theorem 2.1. There exists a universal positive constant p such that no polynomial time 
algorithm can compute a pn-best solution of the 2-dimensional nonlinear optimization 
problem min{f(Wx) : x G S} over every independence system S C {0, l} n presented by 
a linear- optimization oracle, with W an integer 2xn weight matrix each column of which 
is one of the unit vectors in 1? , and f an explicit function supported on {0, 1, . . . , n} 2 . 

In fact, the following explicit statement holds. Let I be any positive integer with I > 2 10 , 
k := 71, m := 8l 2 , n := 2m, and p := A. Let W be the 2xn matrix with first m columns 
the unit vector li and last m columns the unit vector 1 2 . Define f on 1? explicitly by 

f(n,\ - ff., \ — I ^~ k ) - l (V2-k) -I ifk + l< yi ,y 2 <k + l, 

f{3l) - f(yuV2) - I Q otherwise. (3) 

Then at least 2±^™ queries to the oracle of S are needed to compute a j^n-best solution. 

Proof. Let I > 2 10 be a positive integer, k, m, n, p and W as above, and / as in ([3]) above. 
It is more convenient here to work with set systems over ground set N := {1, . . . ,n} 
rather than sets of vectors in {0, l} n . As usual, vectors x G {0,1}™ are in bijection 
with subsets X C ./V with corresponding elements satisfying X = supp(x) the support 
of x and x = lx the indicator of X. So we replace each S C {0, l} n by the set system 
S := {X = supp(x) : x G S}. Also, for c G Z n and X C N we write cX := clx- Let 
N\ y N2 = N be the natural equipartition of the ground set defined by N% := {1, . . . , m} 
and N2 ■= {m + l,...,2m}. For each subset X C N of the ground set we write 
Xi := X n Ni, X 2 := X n 2V2, with X = X\ ttl X 2 the naturally induced partition of X. 
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The image of X = Xi l±l X 2 is denoted by WX := Wlx and is equal to (|Xi|, |X 2 |). 
The image of a set system S over N is WS := {WX : X £ S}. We use several set 
systems over N, defined as follows. First, for each pair of integers < yi,y 2 <m, let 

Syi,y 2 ■= {X = X 1 \SX 2 : \X 1 \=y 1 , \X 2 \ = y 2 } ■ 

Next, let 

S* := {X : (\Xi\,\X 2 \) < (m,k) or (|-Xi|, \X 2 \) < (k,m)} . 

Then S* is an independence system whose image is given by 

WS* = {(2/1,3/2) £2+ : (2/1,2/2) < (m, k) or (y%, y 2 ) < (k, m)} . 

Moreover, the objective function value of every X £ 5*, and hence in particular of every 
pn-best solution of the minimization problem over S* , satisfies f(WX) = 0. 
Next, for each Y € Sk+i,k+h let 

S Y := S* U {X : X CY} . 

Then Sy is also an independence system, with image 

WS Y = WS* bd {(2/1,2/2) : (k + l,k + l)<( yi ,y 2 )<(k + l,k + l)} . 

Moreover, the objective function values of the points in Sy \ S*, whose images lie in 
WSy \ WS*, attain exactly alH 2 = j^n > pn values — 1,— 2,...,— I 2 , and so the value 
of every pn-best solution of the minimization problem over Sy satisfies f(WX) < —1. 

For each vector c6Z" and each pair 1 < i\,i 2 < I, let 

Ti u i 2 (c) := {Z G S k+ i lt k+i 2 : cZ > max{cX : X G S*}} . 

Claim: For every c6Z" and every pair 1 < i%, i 2 < I, we have 

Proof of Claim: Consider any pair U = U± t+J U 2 , V = V\ tt) V 2 £ % lt i 2 {c). We now show 
that either \Ui n Vi| > + 1 or | fT" 2 n V 2 \ > k + 1. Suppose, indirectly, this is not so. Put 

X := (C/inVi) wCt/bu^), 
f : = (u 1 uv 1 )\a(u 2 nv 2 ). 

Then |C7i nT^Lj < fe and \U 2 UV 2 \ < m imply X £ S* , and |C/iUVi| < m and iL^nV^I < k 
imply Y £ S*. We then obtain the following contradiction, 

< cU-cX = c{U x \ Vi) - c(y 2 \ U 2 ) = cY-cV < 0. 

So indeed, for every pair U = U\ l±) U 2 , V = V\ t+J V 2 £ %i,i 2 { c ) ^ Sk+h,k+i2i either 
\Ui D Vi\ > k + 1 or |J7 2 D V 2 \ > k + 1. Therefore, we can now apply the extended 
Erdos-Ko-Rado theorem for direct products of Frankl [3, Theorem 2], which implies 

m-(k + l) \ I ( m \ ( m-{k + l) \ / ( m \ \ 
(k + h) - (k + 1)J / [k + h) ' \(k + i 2 ) -(k + I)) I [k + i 2 ) J 



r^i,*2 ( c ) ^ 

- — ; 1 < max 
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from which it is easy to conclude that, as claimed, 



We continue with the proof of our theorem. Since k = 71, m = 8l 2 and I > 2 we get 
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Consider any algorithm attempting to obtain a pn-best solution to the nonlinear 
optimization problem over any system S, and let c , ...,c 9 € Z n be the sequence of 
queries to the oracle of S made by the algorithm. For each pair 1 < ii,i2 < I and each 
Z G 7i l5 i 2 (c p ), the number of y € S^+i^+l containing Z, and hence satisfying Z € <Sy, is 

fm- (k + ii)\fm- (k + i 2 )\ /m\ 2 
So the number of K G S^+i^+i containing some Z which lies in some l~i 1 ,i 2 {c p ) is at most 

eee(7)W)i s ^(7) 3 ( t ; ; )' 

p=lil=li 2 =l V 7 \ / \ 1 / 

Therefore, if the number of oracle queries satisfies q < /~ 2 (2 -9 /) 2 ', then there exists 
some Y £ Sk+i,k+i which does not contain any Z in any Ti 1) i 2 {c p ). This means that any 
Z € 5y satisfies c p Z < max{c p X : X € S*}. Hence, whether the linear-optimization 
oracle presents S* or Sy, on each query c p it can reply with some X p € S* attaining 

c p X p = max^X : X € S*} = max{c p X : X G Sy} . 

So the algorithm cannot tell whether the oracle presents S* or Sy, whether the image 
is WS* or WSy, and whether the objective function value of every pn-best solution 
is zero or negative, let alone compute any pn-best solution. Therefore, with / > 2 10 , 
every algorithm which can produce a pn-best solution for the 2-dimensional nonlinear 
optimization problem ([1]) over every system S must make at least an exponential number 

q > r 2 (2- 9 lf > r 2 2 21 > 2 l = 23^ 
of queries to the oracle presenting S and therefore cannot run in polynomial time. □ 



4 



References 

[1] Berstein, Y., Lee, J., Maruri-Aguilar, H., Onn, S., Riccomagno, E., Weismantel, R., 
Wynn, H.: Nonlinear matroid optimization and experimental design. SIAM Journal 
on Discrete Mathematics 22:901-919 (2008) 

[2] Berstein, Y., Lee, J., Onn, S., Weismantel, R.: Parametric nonlinear discrete opti- 
mization over well-described sets and matroid intersections. Mathematical Program- 
ming (to appear) 

[3] Frankl, P.: An Erdos-Ko-Rado theorem for direct products. European Journal of 
Combinatorics 17:727-730 (1996) 

[4] Lee, J., Onn, S., Weismantel, R.: Approximate nonlinear optimization over 
weighted independence systems. SIAM Journal on Discrete Mathematics 23:1667- 
1681 (2009) 

[5] Onn, S.: Nonlinear Discrete Optimization: An Algorithmic Theory. Zurich Lectures 
in Advanced Mathematics, European Mathematical Society, 1-143, in process. 

[6] Papadimitriou, C.H., Yanakakis, M.: The complexity of restricted spanning tree 
problems. Journal of the ACM 29:285-309 (1982) 



Jon Lee 

IBM T.J. Watson Research Center, Yorktown Heights, USA 
Shmuel Onn 

Technion - Israel Institute of Technology, Haifa, Israel 

Robert Weismantel 

ETH, Zurich, Switzerland 



5 



